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ABSTRACT 

The National Assessment of Educational Progress 
(NAEP), the Nation's Report Card, has developed and pilot-tested a 
variety of hands-on science and mathematics tasks* These tasks were 
developed as prototypes for use in future national assessments ■ but 
the concepts measured and the innovative approaches used are equally 
suitable for classroom learning, This manual is designed for use by 
science and mathematics coordinators and teachers to share these 
techniques. To develop these hands-on activities, NAEP invited the 
views of science and mathematics educators and worked closely with 
members of the United Kingdom's Assessment of Performance Unit at 
Kings College, London University, Tasks were administered as group 
activities, station activities, and as complete experiments. About 
1,000 third-, seventh^, and eleventh-grade students from 12 school 
districts across four regions of the country were assessed, with 
approximately 100-300 responses obtained for each task, Results 
showed that students responded to the tasks, and results conformed to 
expectations about basic developmental trends in thinking skills, In 
response to the pilot study, 11 tasks field-tested by NAEP were 
selected to show a range of possibilities for classroom and 
assessment use. Each task is presented by thinking skills necessary 
for successful student performance and the administration mode used 
by NAEP. Hierarchically arranged tasks are divided into the following 
sections: (1) classifying; (2) observing and making inferences; (3) 
; formulating hypotheses; (4) interpreting data; (5) designing an 
experiment, and (6) conducting a complete experiment. The 
presentation for each task includes a brief explanation of the 
activity; the student response sheet, a list of the equipment used, 
and one or more exemplary student responses . (LMO) : 
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Learning by Doing; A Manual for Teaching and Assessing Higher-Order Thinking in Mathematics and Science 

This manual is designed for use in our dairy lives to make impor* essary to organize and cany out 

by science and mathematics coor- tent decisions based on new projects in an increasingly com- 

dlnators and teachers, medical and scientific discoveries plex world. Hands-on instruo 

have also served to heighten tional activities give them the 

Why Hands-on interest in science and mathemat- opportunity to use knowledge 

Assessment? ies education. Aimough all and skills to solve problems and 

schools require some mathemat- find out how and why things hap* 
improving ways to teach and lea student participation in sci- pen. Further, it Is critical that 
measure higher-order thinking ence courses is not widespread in assessment procedures be con- 
skills has become a national pri- American schools. This is partieu- slstent with the best of these 
orfty, primarily because A Nation Iariy true In elementary schools, instructional practices. In First 
at Risk and other prestigious where, according to the Associa* Lessons, U.S. Secretary of Educa* 
reports have identified a crucial tion for Supervision and Curricu- tion William J, Bennett writes; 
need for more sophisticated skills lum Development, a typical 

among our nation's students. For fourth-grade curriculum allots " The problem of assessment 

example, Educating Americans onty 28 minutes per day to sci- f ,so constrains the spread of 

form 21st Century, m report ence. fteliminary data from 'hands-on' science, It is rela- 

of me national Science Board's NAEP's 1986 science assessment tlvefy easy to test children's 

Commission on Frecollege Educa- show nearly one*fourth of the knowledge when they have 

tion in Mathematics, Science and third graders reported that they been asked to memorize lists 

Technology, stated, i5 We must rarefy or never had science class. of data for fl t€st 11 is much 

return to the basics, but the Even in me higher grades, stu- harder to des, S n tests ^ 

basics of the 21st century are not dents did not report taking a van- measure learning derived from 

only reading writing, and arith- ety of science courses, While d ' rect experience; some school 

metic. They include communica- many eleventh graders reported ^sterns provide checklists of 

tion and higher problem-solving having taken biology, less than students' ability to perform 

skills, and scientific and techno* 40 percent had taken chemistry experimental tasks. The chal- 

logi'cal literacy—the blinking and only about 10 percent had ! en S c Mom ^"ce educators 

tools that allow us to understand taken physics. is to develop better means of 

the technological world around This relatively low participation measuring both factual knowi- 

us. These new basics are needed in science courses suggests that ^S e jnd the kinds of under- 

by ail students. . , ." many students may have limited standing students acquire 

The emergence of new jobs experience vvith laboratory or through activities, when that 

requiring technological skills and hands-on applications of scien- task Is accomplished, a major 

expertise, concern about the tific and mathematical concepts, roadblock to science achleve- 

world environment and me need Students should have bom the ment ^ havc mn removed," 

concepts and process skills nec- 
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HAEP, the nation's Report Card, 
has developed and pilot-tested a 
: variety of hands-on science and 
mathematics tasks. These tasks 
were developed as prototypes for 
use In future national assess- 
ments, but the concepts mea- 
sured and the innovative 
approaches used are equally suit- 
able for classroom learning, This 
manual is designed to share 
these techniques. 

What are the tasks like? 

The tasks presented in the follow- 
ing pages require students to 
tiiink independently about a vari- 
ety of relationships In mathemat- 
ics and science. At the first level 
of the hierarchy, students are 
asked to classify and sort by 
identifying common characteris- 
tics of plants and animals, At the 
next level, students are given 
materials, equipment, and/or 
apparatus that exemplify particu- 
lar mathematical or scientific phe- 
nomena or relationships and are 
asked to observe, infer, and for- 
mulate hypotheses. Another set 
of tasks is designed to measure 
students' ability to detect pat- 
terns in data and interpret the 
results, At the most complex 
level, students are asked to 
design and conduct complete 
experiments. 



How were the tasks 
developed? 

To develop handai activities 
asking students toiolve prob- 
lems, conduct invtijationss, and 
respond to question using mate- 
rials and equlpmeii MAEP Hnvited 
me views of many science anid 
mathematics educators, MABCP 
also worked clostlfih metan- 
bers of the United Hngdom**s 
Assessment of f ©finance - Unit 
and tiielr scienee-initoringj staff 
at Kings College, London Ursiver- 
slty. Many of the tails were 
adapted from thoseused wmc- 
cessfully in England, Wales, sand 
Horthem Ireland. 

How were the tasks 
administered? 

Because a major goal of this^ pilot 
project was to judge the feasibility 
of more innovative and comiplex 
assessment procefe HAE5F 
developed prototyp of different 
administratJQn formi, incluading 
paper/pencil tasks,taonstra- 
tions, computer*aciiiistere«<J 
tasks, hands-on tasks, and vari- 
ous combinations gfthese tor- 
mats, These were {souped tato 
three major administration 
modes, 

L Group actlvitimm adminis- 
tered to intact classes. Tft*cse 
tasks asked for op-ended 
paper/pencil reapses to 



problems posed in various 
ways. One task included a 
demonsbation of an experi- 
ment by the exercise adminis- 
trator. The remaining tasks 
were based on various types of 
written or tabular information, 

2, Station activities were hands- 
on tasks that required stu- 
dents to use equipment or 
materials to investigate rela- 
tionships and then answer 
open-ended questions based 
on their findings. These activi- 
ties were divided into two sets 
of six tasks for each grade 
level. Groups of six students 
were given the tasks, with stu- 
dents rotating from activity to 
activity every eight minutes. 
One task in each of the sets 
was administered by com- 
puter, Students received direc- 
tions and recorded their 
answers by using the com- 
puter. 

5, Complete experiments were 
administered to individual stu- 
dents. Theadminisfrator 
nosed tiie questions, 
explained the equipment, and 
used a checklist to record how 
students used the equipment 
to conduct their experiments, 
After students had completed 
their investigations, they dis- 
cussed their findings with the 
adminisfrator. 
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Wio participated in the 
pilot testing? 

Twelve school districts across the 
four regions of the country parties 
pated in the pilot project. Within 
each region NAEF selected 
schools in middle-income urban, 
disadvantaged-urban, and small- 
city areas. Twenty-two framed 
administrators assigned in teams 
of three conducted the pilot study 
during April 1986, About 1,000 
third-, seventh-, and eleventh- 
grade students were assessed, 
with approximately 100-500 
responses obtained for each task, 

What did the results show? 

HAEP collected the pilot data pri- 
marily to assess the quality and 
grade-level appropriateness of the 
teste rather than levels of student 
performance. From ttiis perspec- 
tive, the findinp served their pur- 
pose, They indicated that stu- 
dents responded to the tasks, 
and in some cases, did quite well, 
Also, the results conformed to 
expectations about basic develop- 
mental bends in thinking skills, 
For example, improved levels of 
performance wereobserved 
across ail three pde levels, 
and— given the grade-appropri- 
ateness of the -tasKs — students 
had less difficulty with the sorting 
and classifying teste than with 
determining relationships and 
conducting reliable experiments. 



However, staff and consultants 
wanted to know much more. The 
promise of new information 
obtainable from a hands-on 
national assessment was perhaps 
the source of most enthusiasm, 
Questions abounded; How does 
performance vary according to 
students' backgrounds? Are there 
particular patterns of success 
across tasks? What problem- 
solving approaches do students 
use and how do those affect 
performance? 

What did MEP learn? 

Although managing equipment 
and training adminlsfrators 
requires ingenuity and painstak- 
ing effort, conducting hands-on 
assessment is feasible and 
extremely worthwhile, The school 
administrators, teachers, stu- 
dents, and consultants were all 
very enmusiastic, The students 
found the materials engaging, 
and the school staff and consul- 
tants were more than supportive 
in encouraging further use of 
these kinds of tasks in bom 
insfruction and assessment, 

Many educators hope for rys- 
tematic changes that will enable 
more hands-on teaching in sci- 
ence and mathematics class- 
rooms, Teachers need the politi- 
cal financial and administrative 



support tint! allow them to 
concentrate oi developing ideas 
and buildinpthe process sHdlls 
necessary frtdents to leann to 
solve pfopliiand accomplish 
complex tail 

WhytlUniual? 

In respond lie interest ancd 
enthusiasm km in the pilot 
study, tmrtiiityMns pre- 
sentellWiiiild-testedby 
fWTheseie selected to 
show a rarige of possibilities for 
both classrocmand assessment 
use, Many of he ideas underljHng 
tile haridfrOiitasks can be 
adapted to i finely of dteiitt 
science and Hematics con- 
cepts, In addition, such proce* - 
duresis twirdemonsfratiwns 
using ipprti paper/pencil 
applications etae aspects of 
thinking tas^and computer 
simulations on be Integrated 
with hands^onexperiences to 
ease the burden of managing stu- 
dents and equipment, 
Each of thefcWng iliuitfatt've 
tisks is fderitlled by the thinRiBng 
skills ntctsif for successful 

student perfcince and the 
adniiniiffaticimodeiisedby 
HAEP, The priiitation for each 
task Include! slsrief explanatioen 
of the acttvi^i student 
response sW a list of the 
equipment Urt and one or 
more exernplaptudent 
responses. 



Ration AcfMty, Grades 7 and 1 1 : 




Mi 

IP' 




gStudente are asked to sort a col* 
|liction of small-animal vwtebrae|| 
| into fliree pups and explain fM 
plow the bones In Utose groupings! 
Me alike, To complete this task)!! 
8 atudenti need to mala careful . ,« 
pobsen/itions about the simllari- f 
§ ties and differences among the : k 
fc bones and to choose their calse^ 
^ gories accordinq to sets ofcom- ; 
femon characteristics, 

Classifying tasks can be devel^ 
sing a wide variety of 
U objects or pictures of objects 
Including seeds, leaves, shells, 
birds, fish, and floors,. 



ifc 
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Vertebrae shows ftat tasks 



prequiri^ classification need not | 
|fe be confined to younger students.-;:^ 



||; Indeed, Vertebrae presenrea a 
|. challenge to older students, with 1 
I sophisticated materials that 
required them to distinguish 



'! among detailed characteristics 
,s jg when ift^ formed their groups. 

^ Equipment Required 

# Seven bones labelled A-L as follows: 

|r;B* (Mai rabbit 

|^P- Thoracic cit: 
I?: E s Lumbar dog 
F=Attodog 



■I 



Cental rabbit 
H-Cervtci! dog 
j^Lumbir rabbit 
K^Thorade rabbit 
L~LumbiF rabbit 





Classify in 



The question with 
successful responses 



WHAT IB THE SAME ABOUT TOT BONES IN BACH GROUP? 



Hera's what you do i 

1) Look at the collection of labelled bones* These bones are 
from the backbones of different animals. 

Activities 2) Put the bones into three groups. Make sure that there is 
to Conduct something the same about all the bones in each group. 

You must use all the bones, 

What did you find : 

Record 3) Write the letters of the bones in your three groups, 

Findings 



Group At C. 15 . K 



(Omde 11) ► 



Group B 5 A j €,^T } L 
Group C: 3 - t 



Account for 
Findings 



4) What is the same about the bones in each of your three 
groups? 

Group A: nJlhavf cml torg piecp p^jerhVig ^ cM, 
Uaft*C Hale in m\dd\t oP rjanrml p&r-f 
Group B- gJ-t k&A^e & roiMmJ hvy tAj'ith 



holt n vA fWo ionf^ piecJa prn^rhU ^ 
Group Ci ail aYi &*eY\\in\ly tk. U^^Tal *,hrurhttn* 

u)rtfi fl Jiote ih Vkt middle and no itw^sUtA 
iptolg ffpjer-rmg efrf rftj?M^ 
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Station Activity, Grades 3 and 7 



Students compare the weights of 
each of four blocks and observe 
how each Individual block affects 
the movement of the Wig-Wag 
apparatus. The students then are 
asked to describe the relationship 
between the weight of each block 
and how the apparatus moves. To 
complete this task successfully, 
students need to carefully 
observe how each of the blocks 
affects the motion of the Wig-Wag, 
integrate these findings, and 
make generalizations about the 
relationship between weight and 
rate of movement. 



< Equipment Required 

* One Inertia balance 

* Two large e-clamps 

» One block of lead labelled A 

* One block of aluminum labelled B 

* One block of wood labelled C 

* One block of balsa wood labelled D 
- A pan scale 

* A timer 

■ Graph paper 



Observing and Making Inferences 



HOW DOES THE WIG-WAG MOVE WffH Tffi 
DIFFERENT BLOCKS K THE TRAY? 



This |s the Wl jWag. Push the end of the tray sideways i bit and then lit go. 
Do you see whit happens? This Is the reason we call It a Wlf Wag, 

Here's what you do ; 

1 ) Look at the blocks labelled K B. d and D. 

Activities 21 Lift each block one at I time, What do you nstiee about the 
to Conduct blocks? 

Record — 



Activities 3) Put one of the four blocks In the tray and mci/e the 
to Conduct Wig-Wag, Notice how the Wlf Wag moves, Now try with the 
other bloeki, 

Explain whit Vou found ; 

4) Describe the relationship between the weight o| the blocks 
and how the Wig-Wig moves, 



Record and 
Account for 
Findings 



£kg uly hi P ^_ii navp* UMd££ 
fl£f Lft.it? 



The question with im 
sucmsful student 
mponsestopBrti 



(Grade 3) L 
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Wateh as the teacher docs the experiment 

Watch the Whir iybirf am carefully each time until it stops, 

Observe (1) The ball bearings were put In the two outside holes, 

Demonstration The Whir lybird arm was wound up exactly three times 
and let go, 

(2) Hie ball bearings were put In the next two holes, The 
arm was wound up exactly thre? times and let go, 

(3) The ball bearings were put in the next two holes. The 
arm was wound up exactly three times and let go. 

WHAT WAS DIFFERENT ABOUT Tlffi WAY Hffi mngLWWB ARM MOVED 
mm TM STEEL BALLS WERE W TTO DE FERENT HOLES? 

(A) Use this space to jot down notes about what you see happen 
when the steel balls are moved to different holes, 



(Bj Use this space to write down your answer to the question In the 
box, 

Record IlM ClgSeser tkau nr& -tn-kh* 
Findings i , - 

mddk the jytfj \t y<>c.__ 



(Gmde3)A 



(Qrade 7) k 
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Ttm question with two 
successful student 
responds 



tratlon 



s the teacher does the experiment 

he Whirlybird arm carefully each time until it stops* 

(1) Hie ball bearings were put in the two outside holes, 
The Whirlybird arm was wound up exactly three times 
and let go, 

(2) The ball bearings were put in the next two holes, The 
arm was wound up exactly three times and let go, 

(3! The ball bearings were put In the next two holes, The 
arm was wound up exactly three times and let go. 



NAB DIFFERENT ABOUT THE WAY THE WHIRLYBIRD ARM MOVED 
PHEN THE STEEL BALLS WERE W THE DIFFERENT HOLES? 



(A) Use this space to jot down notes about what you see happen 
when the gtae! bails are moved to different holes, 



(Bj Use this space to write down your answer to the question in the 
box, 



it 
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Station Activity, Grade 1 1 



Students identify each of five 
identically sealed objects by con- 
necting the boxes that encase 
them, one by one, to an eieetrie 
circuit The students need to 
make careful observations and 
interpretations of what occurs as 
each sealed box is tested. Some 
knowledge of electric circuits and 
the conductivity of different mate- 
rials Is needed fair this exercise. 



< Equipment Required 

five sealed black boxes lobbied A-E contain- 
big the following materials: 

A = a piece of copper wire 
B ^ a resistor 
C ™ a piece of wood 
? - a diode 

E = a micro relay (variable conductor) 

* A circuit set up with three 1,5-voIt batteries 
In holder 

* A socket for testing the boxes 
■ Three spare batteries 

Apparatus for the circuit should be set up as 
shown in the diagram below* 



Batteries 

H# 1 

(Ft) — Ammeter 

- t .__[ 

l Socket for testing boxes 
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WHAT HAPPENS WIfflN YOU PUT WATER ON TlffiSl THINGS? 



Hera's what vou do r 

Activity l] Place a drop of water on each material, 
to Conduct 



Record 
findings 



Formulate 



Explain: 

Account for 
Hypothesis 



2) Look carefully, What do you see? 
Write down what happens to the water on each of tf ie 
materials, 

A) F'astie hflfefo ,{n^g 



Bj Painted wnnri mfk f j hnfipf? 5 



CJ Brick- bite cry y/ f ^ ft 

E) Roof shingle JT^/qa^s sa ya^ _ ^ ^ 

F] (Maw I-f £\tky% JAfi f^ffy,* 

3) Now use your magnifying glass and look at each material 
very closely, 

4) Look at the material In the plastic bag veiy closely. 
Do not open the bag, 

6) Write down what you think would happen If you put a drop 
of water on the material in the bag, 



iesis ft tot^ jhffrlij 



6) Write down why you think this will happen, 



The question 
with t successful 
student rmpgnM 




Station Activity, Grades 7 and 11 



Students are given a permanentHy 
assembled double staircase four 
blocks high and some loose 
blocks* Students first determine 
how many blocks are LIiC give^i 
staircase and then apply numeri- 
cal reasoning to figure out how 
many blocks would be needed to 
build similar staircases six and LO 
blocks high. Finally, students ar& 
asked to de 'ermine the mathe- 
matical relationship between a 
staircase of any given height and 
the number of blocks needed to 
build It 



*4 Equipment Required 

■ Poubie staircase of wooden blocks that If 
blocks high and glued to a base 

* 24 loose wooden blocks that are Identical 
those used In the staircase 

* Graph paper 

* A pencil 

■ Note? The 24 loose blocks permit a student 
to extend the staircase to six blocks high* but 
are not enough to build a staircase ten bloch^^ 
high. 
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ormulati rig Hypoth 



The question with a 
successful response to 
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HOW MANY BLOCKS ARE SN THE DOUBLE STAIRCASE? 



Hergj what you do * 

1) Look at the double staircase of blocks. 



Activity 
to Conduct 

Record 
Findings 



2) The staircase is 4 blocks high. How many blocks are in tha 
staircase? 

3) How many blocks would be in a similar staircase 6 blocks 
high? How did you figure out your answer? 



Formulate 
Hypothesis 



4) How many blocks would you need to build a similar stair- 
ease 10 blocks high? How did you figure out your answer? 



5) What Is the relationship between a similar staircase of any 
height and the number of blocks needed to build it? 



Formulate 

Generalized 

HjTpothesls 





Group Activity, Grades 3, 7, and 11 



Students are required by this 
paper and pencil task to evaluate 
the results of five children In 
three athletic events (he,, ftnsbee 
toss, weight lift, and 50-yareI 
dash) and decide which of the 
five children would be the all- 
around winner. Students need to 
devise their own approach for 
reviewing and interpreting the 
data, apply it and explain why 
they selected a particular "win- 
ner," Students also need to be 
careful In their Interpretation 
because lower scores In the 50- 
yard dash are better than higher 
scores, while the converse is true 
In the fnsbee toss and weight lift. 
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erpreting Data 



The question with 
MUocessftil student 
responMM 



Joe, Sarah* Josk Zabl, and Kim decided to hold their own Olympics after 
Pitching the Olympics On TV, They needed to decide what events to have it 
their Olympics. Joe and Josi wanted t weight lift and a frisbee tosi event. 
Sarah, Zabl, and Kim thought running a race would be fun. The children 
decided to hive all three events. They also decided to mike each event of the 
same Importance, 



Joe, Sarah, Jest Zabi, and Kim decided to hold their own Olympics after 
watching the Olympics on TV, They needed to decide what events to have at 
their Olympics, Joe and Josg wanted a weight lift and a frisbee ton event, 
Sarah, ZabL and Kim thought mnning a race would be fun. The children 
decided to have all three evente, They alio decided to make each event of the 
same importance, 

One day after school they held their Olympics, The children s parents were 
the judges and kept the children*! scores on each of the events. 

The children's scores for each of the events ire listed below,- 



Child a Name 
Joe 
Jos£ 

mm 

Sarah 
Zabl 



Ftiibee Toss 
40 yards 
30 yards 
48 yards 
28 yards 
48 yards 



Weight Lift 
205 pounds 
170 pounds 
130 pounds 
120 pounds 
140 pounds 



SOrYardDash 
9,8 seconds 
8.0 seconds 
9,0 seconds 
7,8 seconds 
8,3 seconds 



Record 
Findings 



(A) Who would be the all-around winner? 



Account for 
Findings 



(Bj Explain how you decided who would be the all-around 
winner, Be sure to show all your work, 

f ^rate I* *rhr^\\ Stereo 
fipr^%f ^ja-SE^ fksJLjhsa 



after school they held their Olympics, The children's parents were 
:s and kept the children's scores on each of the events, 

iren's scores for each of the events an listed below: 



a Name 


FflsbeeToss 


weight Lift 


50-Yard Dash 




40 yards 


205 pounds 


9J seconds 


m 


30 yards 


170 pounds 


8,0 seconds 


m 


4S yards 


130 pounds 


9,0 seconds 


irih 


28 yards 


120 pounds 


7,6 seconds 


h 


48 yards 


140 pounds 


8,3 seconds 




(A) Who would be the all-around winner? 
Ml 



for 



Explain how you decided who would be the all-iround 
winner, Be sure to show ill your work. 

TviumbcTd iMuMJm \&z 1teM£Um§Jk 
.gJkwafft ff f. 1m T HAiH &t WW stem 



%r zacft of m m&ML lotii San n ii, 



4 (Oracle. 7) 



A (Grade 11) 
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Heart Rate . 
and Exercise 



The experiment will] 
a successful student 
response 
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aareatrestSup- 



stions 



hove 



What 



to these ^ e 




Students design a reliable experi- 
ment to determine the effects of 
exercise on heart rate, In design- 
ing this experiment, students 
need to identify the variables to 
be manipulated, specify what 
needs to be measured, and 
describe how the measurements 
should be made to provide reli- 
able results Jhis exercise is 
included as a prototype technique 
to assess students' understand- 
ing and planiiing of scientific 
investigations when actual experi- 
mentation In a classroom or 
assessment setting is difficult 
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Designing a n, Experi irien t 



identifying Variables, Fonmulating Hypatheses, and SptcifyMng Measurements 
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CQrn^^iet© B^erimenf, Grade 3 



Stud^Bnts are given laboratory 
equij^ment and asked to deter- 
mine which type of sugar, granu- 
lated or cubed, dissolves faster 
when . placed in warm water that is 
stirre«d and not stirred, respec- 
tively^ To complete this investiga- 
tion, ^^tudents need to Identify the 
variafcsles to be manipulated, con- 
trolie^d, and measured* They also 
ne^d r^±o make reliable and accu- 
rate r&ieasurements, record their 
findlrt^cjs, and draw conclusions, 

^qfprsrient Required 

* SU 5T*rw\m\\ glass beakers 

* Sugar^^ cubes In packet 

* Six p^*ckages of granulated sugar, each 
contassning the same mass of sugar as In 
on© n ' 

* Hot vt^mtmr In thermos (50 B C-60 S C) 

* A tjm^» 

* A gra^Suated beaker 

* A rnc^fcmsuring cup 

* A gracM uatcd cylinder 

* A SrnajLJl ruler 

* Paper ^"tewels 

* Paper 

* A f*gnc— fl 



Conducting a Complete Experiment 



Identifying Variables, Formuioting Hypotheses, Taking Measurements, Interpreting Data, and Drawing Conclusions 



riAEPadminisbators used pre- 
pared scripts to present com* 
p/ete experiments to individual 
students. Most of the scripts con- 
tained brief background informa- 
tion on tie problem, the problem 
/£§§/£ and an explanation of the 
equipment available to investigate 
it As each student worked, her 
or his activities were recorded by 
the administrator on a detailed 
checklist covering students ' 
approaches to the problem, 
including how they set up the 
experiment manipulated the 
variables, and measured the out* 
come, The administrator encour- 
aged students to make notes and 
record findings on a response 
sheet 

The Observation 

Using detailed checklists, MAEP 
administetors recorded stu- 
dents' stategies for determin- 
ing—wltti accurate and reliable 
measurements— whether 
loose sugar or sugar cubes dis- 
solved at a faster rate, Success- 
ful strategies included; 

• testing both types of sugar; 
and 

• testing each by stirring and 
not stirring; and 

• maintaining equal and/or 
consistent rates when stirring; 
and 

• measuring to ensure equal 

{ FR?C" S °^ su 9 ar m ^ equal 
fe£fe^s of water for each test 

T'. v • -"'j ' :' ' " ' = , 



flm OUT W SUGAR CUBES DISSOLVE FASTER THAN LOOSE SUGAR, 



A) Use the space below ts answer the question in the box. 



teord 
Findings 



Srfr/nAMfi Ul £ml Adjust ilAtit 

£JtJ*lL . 



Thefimt question 
with a successful 
student response 



The second question 
wftfr a successful 
student response 



i 



FIND OUT IF STQUUNG MAMS ANY DIFFERENCE W HOW 
FAST THE SUGAR CUBES AND LOOSE SUGAR DISSOLVE. 



B) Use the ipace below ts anma the question In the box. 



Record 
Findings 



A(Qmde5)b 



Mr— 
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Complete Experiment, Grades 7 
and 11 

Students are asked In this simula- 
tion task to determine which of 
two fabrics would keep them 
warmer on a mountainside on a 
cold, dry* windy day. As In Sugar 
Cubes, students need to identify 
the variables to be manipulated, 
contolled, and measured. They 
also need to make accurate and 
reliable measurements, record 
their findings, and draw a reason- 
able conclusion. However, the 
sophistication and quantity of the 
equipment call for more extensive 
procedures and measurements 
than in the other complete experi- 
ments. 



< Equipment Required 

■ Five cans labelled A-E 

* Two identical aluminum cans A and B 

* One plastic can E with the same dimensions 
as A and B 

* One aluminum can C that Is the same 
height as A* B* and E hut of a larger 
diameter 

* One aluminum can D with the same diame- 
ter as A* B* and E ^ut shorter in height 

. * A aio 8 C thermometer 

* A stopwatch 

* * Rubber bands 
Pins 

- Transparent tape 

* Scissors 

* An elecoie kettle 

* Two graduated cylinders 

■ Sheets of blanket 

* Sheets of plastic 

* An electric fan 

* A small ruler 

* Graph paper 

■ A thermos 

* Paper towels 

* And pencils 




Conducting a Complete Experiment 




The Observation 

Using detailed checklists, NAEP 
adminisfrators recorded stu- 
denis' stategies for detennining 
which material— blanket or plas- 
tic— would keep them warmer in 
cold, dry, windy weather, Stu- 
leeded to be oar 
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careful to test both materials and 
use the best criteria for determin- 
ing the better insulator. For exam* 
pie, successful strategies 
Included: 

• testing both types of materials 
by wrapping them around com* 
parable cans of the same size, 
and cans that contain equal 
amounts of water at the sa/ne 
temperature; 

« taking baseline and final tem- 
perature readings of the water 
in me cans following aired 
penorfoftimeORtakinga 
reading of the time following a 
Mtempemturedrop, 



We question with a successful student response 



lie other complete experi- 
ments, successful investigations 
included accurate and reliable use 
of the equipment* In SumvaL this 
would include efficient use of the 
stopwatch and the thermometer, 



mm mm mi jeep you warmer 

IN COLD, DRY.WOTWMTHER? 



Al Use the space below to answer the question In the box, 
^■Wiji C ' =W ~ "^Wlt^, Vf^ "fe**^ 



1 Whit did you find? Which fabric will keep you winner? 
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Density 



Complete Experiment, Grades 7 
and 11 



Students are given a sample of 
three different materials and an 
open box. The samples differ in 
size* shape, and weight The stu- 
dents are asked to determine 
whether tiie box would weigh the 
most (and the least) If It were 
completely filled with materia] A, 
B # or C* The focus is on which of a 
varied of possible approaches the 
student uses to solve the prob- 
lem* For example, some students 
might recognize that the solution 
involves the computation of the 
densities of the materials. Others 
may use the weights and volumes 
of both the materials and the box, 
or just use the weights of the 
materials followed by estimations 
of the amounts of each needed to 
All the box, 



^Equipment Required 

* Three dlfferentsize blocks (labelled A, B # 
and C) of different shapes and materials of 
different densities — a rectangular solid, a 
cube, and a triangular block that is half a 
rectangular solid 

* a large open box 

* m spring scale 

■ a ruler 

* a hand calculator 

■ paper 

■ a pencil 
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The Observation 

NAEFadmlnlinitorsused 
detailed checklists to record each 
student's procedures and state- 
gies for determining accurately 
which material would make the 
filled box weigh the most— and 
the least Successful sfrategies 
included; 

• weighing and measuring the 
three blocks; computing the 
volumes of the blocks, and 
then computing the density of 
each block without using the 
box 

• weighing and measuring the 
blocks and measuring the box; 
computing the volumes of the 
blocks and the box; computing 
the number of each that would 
fit into the box, and then com- 
puting ite weight filled with 
each type 

• weighing the blocks; estimating 
carefiilly the number of each 
mat would fit Into the box, and 
then computing me weight of 
tile box, 

The adminisfrator also noted 
wheflier me student used units 
consistently and which measure- 
ments, if any, were repeated for 
accuracy. 



The question with a 
successful student 
response 



WOULD THE BOX WEIGH HOST COffflOTtf BUD TO SMlIUMJ 
AORiTOIiOR WITH C? WITH WHICH WOlO IT WIIQH THE LEAST? 



You an us all the Ihtnp on the table (a help pi find the answers, 



A 



Aj Use this space is keep any notes en what you do and whit you 
find out, 

teox M 4he \x* »hl ^ rfrwttrif 



E] FUI in the blanks to complete the se ntenees btlowi 



Record Tfe box would be heaviest filled with matgrlil -5. 
Findings 

Hie b« would Ughttst filled with material _ 
foMa 4he box ^|u| 1/9 



Another successful 
student response using a 
different approach 



WOULD THE POX WEIGH MOIT COMPLETELY FILLED Wm! MAHRlALS 

^Qiwmi&eRTOC^wn^ffflCHwOTO it weigh m le&st? 



Vqu can use all thi things on the table to help pi find the mswera, 

A] Use this space to keep any notes on what you do and whit ysu 
flndouL 



Finding 



B B 4Sqr» 
C s 100 jr, 



C 4 'Fob 



B) Fill In the Winks to complete the sentences below: 

HecQfd The box would be hiaviiit filled with niaftriaJ 
Findings 

Tile box would be lightest led with material 
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Thoughts for the Future 




Results from the Second Interna- 
tional Science Study show that 
our nation's students lag behind 
students in other countries in lab- 
oratory and inquiry skills,* Greater 
attention must be paid in Ameri- 
can schools to higher-order think- 
ing skill s If we are to produce a 
citizenry able to meet our future 
needs, "Hands-on" activities are 
an excellent way to improve pro- 
cess skills, Students have the 
opportunity to see how things 
work, think about relationships, 
plan investigations, and leam 
from their successes and failures. 

Such activities, however, 
require time— time for teachers 
to prepare, time for teachera to 
work with individual students, 
and class periods long enough to 
promote coherent and in-depth 
study. Additionally, teachers, 
administrators, and parents must 
devote the necessary energy and 
resources to help students 
achieve these new goals. This will 
not be easy and will require dedi- 
cation by all concerned, 

Finally, we should recognize 
that schools teach what is tested. 



In conjunction with improving sci- 
ence and mathematics curricula, 
we must provide for both instruc- 
tion and assessment of higher- 
order thinking skills, The use of 
hands-on assessment techniques 
will guide instruction in more 
beneficial directions as well as to 
provide better Information about 
students' understandings of the 
concepts underlying science and 
mathematics, Our hope is that 
tile examples included in this 
manual will facilitate and encour- 
age this process. 



*JiCobsen, WJ. (1987), The current status of 
the Science Curricula: Insights from the Sec* 
ond IntemitJanil Science Study, In This Year 
In School Sdence 1986; The Science Curricu- 
lum, AAA5, Washington, D.C 
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M^OMte^ments 



IWs Riot Study of Higher- 
Order Skills Assessment Tech- 
niques in Science and Mathemat- 
ics involved many experienced 
and taiowledgeable people— staff 
and consultants who contributed 
their ideas, time, and energy to 
the development conduct, and 
documentation of the project, 
Some, because of particularly sig- 
nificant conbibutions, are specifi- 
cally thanked, 



The project was managed and 
implemented by PVan Blumberg, 
Marion Epstein, Walt MacDonald, 
and InaV.S. Mullis, TheA.P.U. Sci- 
ence Monitoring Team was insfru- 
mental to the success of the pro- 
ject especially Fam'eia Murphy, 
Andy Myehajlowycz conducted the 
analysis of the pilot study results, 
and Darlene Wene provided the 
support and excellent word-pro- 
cessing skills essential to the 
study. The following consultants 
provided support during various 
phases of the project; Louis 
Armijo, Joanne Capper, Audrey 
Champagne, Randall Charles, 
Josephine Davis, Roberta Flexer, 
Cindy Hrebar, Jeremy Kilpatrick, 
Qerald Kulm, Richard Mayer, 
James Minstrell, Howard Pollio, 
James Robinson, Beta Schofleld, 
and Gerry Wheeler, Richard Berry 
from MSF deserves special credit 
for providing skillful advice and 
unfailing encouragement 
throughout 

Finally and most importantly, 
HAEP is grateful for the contribu- 
tions of students and schools, 
who cooperated so generously, 



Special thanks for this publica- 
tion are due to many reviewers 
who suggested improvements; 
Kent F. Ashworth, who coordi- 
nated production efforts; Bessie 
M, Emanuel, whose word-process- 
ing and planning efforts made 
this document possible; Joyce 
Hofstetter, who designed this 
manual; and Mark Sherman, who 
took the photographs, HAEF 
appreciates the time and effort 
expended by the following chil- 
dren (and their parents)! David 
Benderson; Theresa Canning; 
Tameka Monique Emanuel; 
Martin Hayes; Katie Mullis Lyon; 
Charles and Kayra Melvin; Joseph 
Ortiz; William Joseph Ritter; 
Darlene and Dawn So*emig 
Marvin Ward; David Weeks; and 
Martin Weeks, 
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